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(54) Image perspective control lor video game images 



(57) The perspective of a displayed video game 
image is moved in order to bring an attentional subject 
into a hypothetical focus frame, and the focus frame is 
moved back to a rear position on an extension opposite 
to the direction in which the attentional subject moves, 
for providing a wide area in front of the attentional sub- 
ject in the direction in which it moves, and the attentional 
subject is brought into the moved focus frame. The rear 
position is a position in which a central reference point 
of the focus frame is located on a boundary line of the 



drcular center movement range when the central refer- 
ence point is moved opposite and parallel to the direc- 
tion in which the attentional subject moves. The wide 
area provided in front of the attentional subject in the 
direction in which it moves, provides enough room for 
maneuver for the game player to take an action easily 
even when an opponent game character suddenly pops 
up in the displayed video game image. 
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Description 

The present invention relates to an apparatus for 
and a method of displaying a video game image while 
moving its perspective in the direction in which a subject 
such as an attentional game character moves in the 
video game image, and a recording medium which 
stores a control program for displaying a video game 
image while moving its perspective in the direction in 
which a subject such as an attentional game character 
moves in the video game image. 

Video game apparatus which display a video game 
image on a display screen are required to move the per- 
spective of the video game image in the direction in 
which a subject such as an attentional game character 
moves in the video game image, in order that the sub- 
ject will remain displayed withn the video game image. 
In another displayed video game image, a moving atten- 
tional game character as rf captured by a video camera 
positioned directly behind the attentional game charac- 
ter is displayed such that the attentional game character 
is looking forward in the background 

When moving the perspective of a video game 
image in the direction in which an attentional game 
character moves, the area displayed in front of the mov- 
ing attentional game character within the video game 
image becomes very small, providing little room for 
maneuver for the game player. For example, if an oppo- 
nent game character suddenly pops up in the small area 
in front of the attentional game character, then the game 
player does not have a sufficient time to avoid the oppo- 
nent game character. 

When a moving attentional game character dis- 
played as H captured by a hypothetical video camera 
positioned behind the attentional game character is 
looking forward in the background of a displayed video 
game image, the game player can clearly see an 
approaching opponent game character in front of the 
attentional game character. However, the game player 
cannot see the attentional game character and its sur- 
rounding areas in an objective fashion because of the 
limited area displayed in front of the attentional game 
character. When an opponent game character comes in 
from a lateral side, since the area displayed in front of 
the moving attentional game character within the video 
game image is small, the game player finds it difficult to 
take an appropriate action easily. 

It is therefore an object of the present invention to 
provide an apparatus for and a method of displaying a 
video game image in a manner to allow a game player 
to see a moving attentional game character and its sur- 
rounding areas objectively and also to clearly see an 
area in front of the moving attentional game character. 

Another object of the present invention is to provide 
a recording medium which stores a control program for 
displaying a video game image in a manner to allow a 
game player to see a moving attentional game charac- 
ter and its surrounding areas objectively and also to 
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dearly see an area in front of the moving attentional 
game character. 

According to an aspect of the present invention, 
there is provided an apparatus for displaying a video 

s image to move a perspective of the image in a direction 
in which an attentional subject moves for displaying the 
attentional subject in an attentional area in the video 
image, comprising: image display means for displaying 
the attentional subject in the attentional area in the 

10 video image; and control means for moving the per- 
spective of the video image in the direction in which the 
attentional subject moves in the video image, and mov- 
ing the perspective of the video image and the atten- 
tional area when the attentional subject is about to 

is move out of the attentional area. 

The control means may move the perspective of the 
video image and the attentional area so that the atten- 
tional subject will be located in a rear position opposite 
to the direction in which the attentional subject moves, 

20 when the attentional subject is about to move out of the 
attentional area. 

The control means may comprise coordinate trans- 
forming means for transforming coordinates of the 
attentional subject in a three-dimensional coordinate 

25 system into coordinates thereof in a plane f ield-of-view 
coordinate system, coordinate holding means for hold- 
ing coordinates of the attentional subject transformed 
by the coordinate transforming means before and after 
the attentional subject moves, image display control 

30 means tor displaying the attentional subject according 
to the coordinates transformed by the coordinate trans- 
forming means, together with a predetermined image, in 
the video image, decision means for deciding whether 
the attentional subject has moved out of the attentional 

35 area in the video image, calculating means for calculat- 
ing a direction in which the attentional subject has 
moved based on the coordinates held by the coordi- 
nate-holding means, if the attentional subject has 
moved out of the attentional area, and image perspec- 

40 tive moving means for controlling the image display con- 
trol means to move the perspective of the video image 
and the attentional area so that the attentional subject 
will be located in the rear position opposite to the direc- 
tion calculated by the calculating means. 

45 The control means may move the perspective of the 
video image and the attentional area, when a reference 
point of the attentional area has reached a first position 
in a reference point movement range, in which the refer- 
ence point is movable, at the time the attentional subject 

so is about to move out of the attentional area, so that the 
attentional subject will be located in the attentional area 
that is moved to a second position in the reference point 
movement range which is in point-symmetry relation to 
the first position across a center of the reference point 

55 movement range. 

The control means may comprise coordinate trans- 
forming means for transforming coordinates of the 
attentional subject in a three-dimensional coordinate 
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system into coordinates thereof in a plane field-of-view 
coordinate system, decision means for deciding 
whether the attentional subject has moved out of the 
attentional area in the video image, and image perspec- 
tive moving means for moving the attentional subject 5 
into the attentional area which is moved, when the refer- 
ence point of the attentional area has reached the first 
position at the time the attentional subject is about to 
move out of the attentional area, so that the reference 
point will be located in the second position which is in 10 
point-symmetry relation to the f irst position across the 
center of the reference point movement range. 

The control means may move the perspective of the 
video image and the attentional area, when a reference 
point of the attentional area has reached a boundary is 
position of a relet ence point movement range, in which 
the reference point is movable, at the time the atten- 
tional subject is about to move out of the attentional 
area, so that the attentional subject will be located in the 
attentional area that is moved with the reference point 20 
thereof located in a first one of divided radial areas of 
the reference point movement range other than a sec- 
ond one of the divided radial areas that is closest to the 
attentional subject. 

The control means may comprise coordinate trans- 25 
forming means for transforming coordinates of the 
attentional subject in a three-dimensional coordinate 
system into coordinates thereof in a plane field-of-view 
coordinate system, decision means for deciding 
whether the attentional subject has moved out of the 30 
attentional area in the video image, and image perspec- 
tive moving means for moving the attentional subject 
into the attentional area which is moved, when the refer- 
ence point of the attentional area has reached the 
boundary position at the time the attentional subject is 35 
about to move out of the attentional area, so that the ref- 
erence point will be located in the attentional area that is 
moved with the reference point thereof located in the 
first one of divided radial areas of the reference point 
movement range other than the second one of the 40 
divided radial areas that is closest to the attentional sub- 
ject. 

According to another aspect of the present inven- 
tion, there is provided a method of displaying a video 
image to move a perspective of the image in a direction 45 
in which an attentional subject moves for displaying the 
attentional subject in an attentional area in the video 
image, comprising the steps of: transforming coordi- 
nates of the attentional subject in a three-dimensional 
coordinate system into coordinates thereof in a plane so 
field-of-view coordinate system; deciding whether the 
attentional subject has moved out of the attentional area 
in the video image; and moving the perspective of the 
video image and the attentional area when the atten- 
tional subject is about to move out of the attentional ss 
area in the video image. 

The method may be appreciated to further com- 
prise the steps of: holding transformed coordinates of 
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the attentional subject before and after the attentional 
subject moves; displaying the attentional subject 
according to the transformed coordinates, together with 
a predetermined image, in the video image; and calcu- 
lating a direction in which the attentional subject has 
moved based on the coordinates which are held, if the 
attentional subject has moved out of the attentional 
area. In this method, the perspective of the video image 
and the attentional area are moved so that the atten- 
tional subject will be located in a rear position opposite 
to the calculated direction. 

The perspective of the video image and the atten- 
tional area may be moved, when a reference point of the 
attentional area has reached a first position in a refer- 
ence point movement range, in which the reference 
point is movable, at the time the attentional subject is 
about to move out of the attentional area, so that the 
attentional subject will be located in the attentional area 
that is moved to a second position in the reference point 
movement range which is in point-symmetry relation to 
the first position across a center of the reference point 
movement range. 

The attentional subject may be moved into the 
attentional area which is moved, when a reference point 
of the attentional area has reached a boundary position 
of a reference point movement range, in which the refer- 
ence point is movable, at the time the attentional subject 
is about to move out of the attentional area, so that the 
attentional subject will be located in the attentional area 
that is moved with the reference point thereof located in 
a first one of divided radial areas of the reference point 
movement range other than a second one of the divided 
radial areas that is closest to the attentional subject. 

According to still another aspect of the present 
invention, there is provided a recording medium which 
stores a control program for displaying a video image to 
move a perspective of the image in a direction in which 
an attentional subject moves for displaying the atten- 
tional subject in an attentional area in the video image, 
the control program comprising the steps of: transform- 
ing coordinates of the attentional subject in a three- 
dimensional coordinate system into coordinates thereof 
in a plane field-of-view coordinate system; deciding 
whether the attentional subject has moved out of the 
attentional area in the video image; and moving the per- 
spective of the video image and the attentional area 
when the attentional subject is about to move out of the 
attentional area in the video image. 

With the above arrangement, when the attentional 
subject is about to move out of the attentional area, the 
perspective of the video image is moved to bring the 
attentional subject to a position in a direction opposite to 
the direction in which the attentional subject moves. 
Therefore, a wide area is provided in front of the atten- 
tional subject in the direction in which it moves. The 
attentional subject and its surrounding areas that are 
displayed in the video image can thus be seen in an 
objective fashion. Since the wide area is provided in 
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front of the attentional subject in the direction in which it 
moves, it provides enough room for maneuver to take 
an action easily even when another subject suddenly 
pops up in the displayed video image. 

The above and other objects, features, and advan- 
tages of the present invention will become apparent 
from the following description in conjunction with the 
accompanying drawings which illustrate preferred 
embodiments of the present invention by way of exam- 
ple, in which: 

FIG. 1 is a block diagram of a video game appara- 
tus according to an embodiment of the present 
invention; 

FIG. 2 is a view of a video game image displayed on 
a television monitor of the video game apparatus; 
FIGS. 3A and 3B are views of video game images, 
showing the manner in which a focus frame and an 
attentional game character are moved back in an 
opposite direction to the direction in which the 
attentional game character moves; 
FIG. 4 A is a view showing the manner in which a 
hypothetical video camera for capturing an atten- 
tional game character is linearly moved horizontally 
along an axis of movement of the attentional game 
character; 

FIG. 4B is a view showing the manner in which a 
hypothetical video camera for capturing an atten- 
tional game character is tilted along a horizontal 
axis as the attentional game character moves; 
FIG. 4C is a view showing the manner in which a 
hypothetical video camera for capturing an atten- 
tional game character is linearly moved vertically as 
the attentional game character moves; 
FIG. 5 is a flowchart of an operation sequence of 
the video game apparatus shown in FIG. 1 ; 
FIG. 6 is a view showing the manner in which a 
focus frame and an attentional game character 
move in a video game image; 
FIG. 7 is a view showing the manner in which a 
focus frame and an attentional game character are 
moved back in an opposite direction to the direction 
in which the attentional game character moves, in a 
video game apparatus according to another 
embodiment of the present invention; and 
FIG. 8 is a view showing the manner in which a 
focus frame and an attentional game character are 
moved back in an opposite direction to the direction 
in which the attentional game character moves, in a 
video game apparatus according to still another 
embodiment of the present invention. 

Referring to FIG. 1 showing in block form a video 
game apparatus 1 according to the present invention, 
the video game apparatus 1 generally comprises a 
game machine (not shown), a television monitor 2 for 
displaying video game images on a display screen 
thereof, an integrated amplifier 3, a speaker 4, and a 



recording medium 5 which stores game data including 
image data, audio data, and program data which 
includes an operating system. The recording medium 5 
comprises a ROM cassette, which is a ROM housed in 
5 a plastic case, an optical disk, or a flexible disk which 
stores the game data. 

The video game apparatus 1 also comprises a CPU 
6, a bus 7 connected to the CPU 6 and comprising an 
address bus, a data bus, and a control bus, a RAM 8 

w connected to the bus 7 for storing various items of data, 
interfaces 9,10 connected to the bus 7, a signal proces- 
sor 11 connected to the bus 7, an image processor 12 
connected to the bus 7, and interfaces 13,14 connected 
to the bus 7. The recording medium 5 is connected to 

15 the interface 9. A manual controller 16 is connected 
through a control information interface 15 to the inter- 
face 10 for supplying control signals to the CPU 6 to 
enable the CPU 6 to issue various commands. 

The signal processor 1 1 serves to calculate two- 

20 dimensional positions and generate and process audio 
data. The image processor 12 serves to generate and 
store image data to be displayed into the RAM 8 based 
on calculated results in the signal processor 11. The 
interface 13 is connected through a D/A converter 17 to 

25 the television monitor 2 for supplying image data from 
the RAM 8 to the television monitor 2. The interface 14 
is connected through a D/A converter 18 to the inte- 
grated amplifier 3 for supplying audio data through the 
integrated amplifier 3 to the speaker 4. 

30 The video game apparatus 1 may take different 
system configurations depending on the manner in 
which it is used. If the video game apparatus 1 is used 
as a home video game system, for example, then the 
television monitor 2, the integrated amplifier 3. and the 

35 speaker 4 are separate from the other parts of the game 
machine. If the video game apparatus 1 is used as an 
arcade video game system, for example, then all the 
parts shown in FIG. 1 are assembled as a unit and 
encased in a single housing. If the video game appara- 

40 tus 1 is constructed around a personal computer or a 
work station, then the television monitor 2 corresponds 
to the display monitor of the computer, the image proc- 
essor 1 2 corresponds to part of the game program data 
stored in the recording medium 5 or a hardware 

45 arrangement on an expansion board inserted in an 
expansion slot of the computer, and the interfaces 9, 1 0, 
13, 14, the D/A converters 17, 18, and the control infor- 
mation interface 15 correspond to a hardware arrange- 
ment on an expansion board inserted in an expansion 

so slot of the computer. The RAM 8 corresponds to areas 
of a main memory or an expansion memory of the com- 
puter In the illustrated embodiment, the video game 
apparatus 1 will be described as a home video game 
system. 

55 The manual controller 16 has a start button 16a. an 
A button 16b, a B button 16c, a cross key 16d, a control 
stick 16e, a left trigger button 16f, a right trigger button 
16g, a C1 button 16h, a C2 button 16i, a C3 button 16j. 
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a C4 button 16k, a connector 16m, and a depth button 
16n. A memory for temporarily storing data with respect 
to the progress of a video game is detachably con- 
nected to the connector 16m. The controller stick 16a is 
movable not only in upward, downward, leftward, and 
rightward directions, but also universally in an angular 
range of 360°. The controller stick 16a basically func- 
tions as a joystick. For example, the game player can 
operate the controller stick 1 6a to turn a displayed game 
character 360° back to its original position, whereupon 
the displayed game character stops its movement. 

Functional blocks of the video game apparatus 1 
will be described in detail below. 

The RAM 8, the interface 9, and the recording 
medium 5 jointly serve as a memory unit 19. The CPU 
6, the signal processor 1 1 , the image processor 12, and 
the memory unit 19 jointly serve as a controller 20. The 
CPU 6 controls the signal processor 11 to process the 
game data including image data, audio data, and pro- 
gram data stored in the recording medium 5. Based on 
the processed data, the CPU 6 controls the image proc- 
essor 12 to generate and store image data to be dis- 
played and audio data to be outputted in the RAM 8. 
The controller 20 effects a control process for moving a 
displayed video game image in the direction in which an 
attentional game character moves in the video game 
image, so that the attentional game character will be 
displayed in a given attentional area in the video game 
image, and also for moving the video game image and 
the given attentional area such that the attentional 
game character will be located in a rear position on an 
extension opposite to the direction in which the atten- 
tional game character moves, when the attentional 
game character has moves out of the given attentional 
area. 

More specifically, the controller 20 functionally com- 
prises a coordinate transforming means for transform- 
ing coordinates of an attentional subject in a three- 
dimensional coordinate system into coordinates thereof 
in a plane field-of-view coordinate system, a coordinate 
holding means for holding coordinates of the attentional 
subject transformed by the coordinate transforming 
means before and after the attentional subject moves, 
an image display control means for displaying the atten- 
tional subject according to the coordinates transformed 
by the coordinate transforming means, together with a 
predetermined image, in a video game image, decision 
means for deciding whether the attentional subject has 
moved out of a predetermined attentional area in the 
video game image, calculating means for calculating a 
direction in which the attentional subject has moved 
based on the coordinates held by the coordinate holding 
means, if the attentional subject has moved out of the 
predetermined attentional area, and an image perspec- 
tive moving means for controlling the image display con- 
trol means to move the perspective of the video game 
image and the predetermined attentional area so that 
the attentional subject will be located in a rear position 



on an extension opposite to the direction calculated by 
the calculating means. 

The interface 10, the control information interface 
15, and the manual controller 16 jointly make up a con- 
5 trol input unit 21 , which supplies control signals entered 
by the game player through the manual controller 16 to 
move a displayed attentional subject to the CPU 6, 
which issues commands to start and continue a video 
game. 

10 The interface 13, the D/A converter 17. and the tel- 
evision monitor 2 jointly serve as an image display unit 
22. Image data generated by the image processor 12 
and stored in the RAM 8 is supplied through the inter- 
face 13 and the D/A converter 17 to the television mon- 

15 itor 2, which displays an attentional subject controlled by 
the game player and surrounding areas in a video game 
image. 

The interface 14, the D/A converter 18, the inte- 
grated amplifier 3, and the speaker 3 jointly serve as an 

20 audio output unit 23. Audio data generated by the signal 
processor 11 and stored in the RAM 8 is supplied 
through the interface 14, the D/A converter 18, and the 
integrated amplifier 3 to the speaker 4, which radiates 
sound depending on the progress of a video game. 

25 A control process carried out by the controller 20 
including the CPU 6 which is controlled by the game 
data including image data, audio data, and program 
data stored in the recording medium 5 will be described 
in detail below. 

30 FIG. 2 shows a video game image displayed on the 
television monitor 2 of the video game apparatus 1 
shown in FIG. 1 . 

Video game images displayed on the television 
monitor 2 will be described as if captured by a video 

35 camera. However, such a video camera is a hypotheti- 
cal video camera, and is not actually connected to the 
video game apparatus 1 . but represents a view point 
from which the displayed video game images are 
viewed. 

40 As shown in FIG. 2, an outer screen frame 31 is an 
outer marginal frame of a displayed video game image 
which is captured by a hypothetical video camera, and 
corresponds to a white marginal frame on a photoprint. 
Within the outer screen frame 31, there is a subject 

45 movement range frame 32 within which an attentional 
subject 33 can move. The attentional subject 33 repre- 
sents, for example, a human being such as a character 
to be focused by the video camera or an object such as 
a symbol. In video games, the attentional subject 33 

so corresponds to a game character which is controlled by 
the controller 20 according to control signals that are 
entered through the manual controller 16 by a game 
player who plays with the video game apparatus 1 . A 
hypothetical rectangular focus frame 34. which is a 

55 given attentional area located within the subject move- 
ment range frame 32, is a hypothetical area for display- 
ing the attentional subject 33 movably therein when the 
attentional subject 33 is focused by the video camera. 
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The rectangular focus frame 34 has a crisscross central 
reference point 36 located centrally therein which is 
movable within a circular center movement range 37 
that is located as a reference point movement range 
centrally within the subject movement range frame 32. 
Therefore, the attentional subject 33 is movable within a 
movement range which is the sum of the rectangular 
focus frame 34 and the circular center movement range 
37 while a video game image displayed within the sub- 
ject movement range frame 32 is being fixed. Although 
the focus frame 34 is shown as rectangular in shape 
and the center movement range 37 is shown as circular 
in shape, they are not limited to those shapes, but may 
be other shapes depending on the shape of the subject 
movement range frame 32. For example, if the subject 
movement range frame 32 is of an elongate rectangular 
shape, then both the focus frame 34 and the center 
movement range 37 may be of an elongate rectangular 
shape If the subject movement range frame 32 has 
arcuate corners, then both the focus frame 34 and the 
center movement range 37 may be of a circular or ellip- 
tical shape. Therefore, the focus frame 34 and the 
center movement range 37 may be of any of rectangular 
shapes including square and elongate rectangular 
shapes, a circular shape, an elliptical shape, etc. 

When the attentional subject 33 moves within the 
focus frame 34. the focus frame 34 and the perspective 
of the entire displayed video game image are not 
moved. When the attentional subject 33 is about to 
move out of the focus frame 34, i.e., when the atten- 
tional subject 33 moves across a boundary line of the 
focus frame 34, the perspective of the entire displayed 
video game image is moved in the direction in which the 
attentional subject 33 moves, in order that the atten- 
tional subject 33 will remain positioned in the focus 
frame 34. At this time, the focus frame 34 moves in the 
video game image in the opposite direction to the direc- 
tion in which the attentional subject 33 moves, to the 
extent that the crisscross central reference point 36 of 
the focus frame 34 will be kept within the circular center 
movement range 37. 

More specifically, when the attentional subject 33 is 
about to move out of the focus frame 34, the perspective 
of the entire video game image displayed in the subject 
movement range frame 32 is moved in the direction in 
which the attentional subject 33 moves, as indicated by 
a transition from the solid-line frame 32 to the dotted- 
line frame 32 in FIG. 3A, so that the attentional subject 
33 will remain positioned within the focus frame 34. At 
this time, the perspective of the entire displayed video 
game image is moved such that the focus frame 34 is 
moved to a certain position in the opposite direction to 
the direction, indicated by the arrow A in FIG. 3B, in 
which the attentional subject 33 moves, and the atten- 
tional subject 33 is kept within the focus frame 34. The 
certain position, referred to above, to which the focus 
frame 34 is moved is a rear position on an extension 
opposite to the direction indicated by the arrow A in 
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which the attentional subject 33 is about to move out of 
the focus frame 34. The rear position, referred above, is 
a position in which the crisscross central reference point 
36 of the focus frame 34 is located on a circular bound- 

5 ary line of the circular center movement range 37 when 
the crisscross central reference point 36 is moved oppo- 
site and parallel to the direction indicated by the arrow 
A. The direction indicated by the arrow A can be deter- 
mined by calculating the direction in which the atten- 

70 tional subject 33 is about to move out of the focus frame 

34 can be calculated, based on the coordinates, held by 
the coordinate holding means, of the attentional subject 
33 before and after the attentional subject 33 moves if 
the decision means determines that the attentional sub- 

75 ject 33 moves out of the focus frame 34. 

The perspective of the entire video game image 
displayed in the subject movement range frame 32 is 
moved in any of various fashions as described below. If 
a hypothetical video camera 35 (see FIGS. 4A - 4C) 
20 which captures the attentional subject 33 is freely mov- 
able horizontally as shown in FIG. 4A, then the camera 

35 may be moved horizontally in the direction in which 
the attentional subject 33 moves. If the video camera 35 
is fixed but tiltable about a horizontal axis as shown in 

25 FIG. 4B, then the video camera 35 may be tilted to shift 
its viewpoint from a foreground area to a background 
area as the attentional subject 33 moves, so that the 
displayed area in front of the moving attentional subject 
33 will remain wide. If the video camera 35 is freely 

30 movable vertically as shown in FIG. 4C, then the video 
camera 35 may be moved upwardly to increase its field- 
of-view (or downwardly to reduce its f iekf-of-view). 

Alternatively, the video camera 35 may first be tilted 
as shown in FIG. 4B and then moved horizontally as 

35 shown in FIG. 4A. Further alternatively, the video cam- 
era 35 may first be moved upwardly as shown in FIG. 
4C and then moved horizontally as shown in FIG. 4A. 

As described above, the attentional subject 33 is 
retained in the video game image by establishing the 

40 hypothetical focus frame 34 as a given attentional area 
and displaying the attentional subject 33 within the 
focus frame 34. Insofar as the attentional subject 33 
moves within the focus frame 34, the hypothetical video 
camera 35 which captures the attentional subject 33 

45 remains fixed and is not moved. When the attentional 
subject 33 is about to move out of the focus frame 34, 
the perspective of the displayed video game image is 
moved in the direction to keep the moving attentional 
subject 33 within the focus frame 34, such that the hypo- 
so thetical video camera 35 moves as the attentional sub- 
ject 33 moves. In order to provide a wide area in front of 
the moving attentional subject 33, the perspective of the 
displayed video game image and the focus frame 34 are 
moved to move the attentional subject 33 to the rear 

55 position on the extension opposite to the direction in 
which the attentional subject 33 moves. 

Operation of the video game apparatus 1 shown in 
FIG. 1 will be described below with reference to FIGS. 5 
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and 6. 

As shown in FIG. 6, when an attentional subject 
33a displayed in a video game image displayed on the 
television monitor 2 moves in the focus frame 34 and 
reaches a boundary line of the focus frame 34, the con- 
troller 20 is controlled by a control program included in 
the program data to store, in the RAM 8, two-dimen- 
sional coordinates (pcx\ pcy^ of the attentional subject 
33 in the video game image and three-dimensional 
coordinates (pwx', pwy\ pwz*) of the attentional subject 
33 in a three-dimensional space before the attentional 
subject 33 moves, in a step S1 . Positional coordinates 
(pwx, pwy, pwz) of the attentional subject 33 change as 
the attentional subject 33 moves in the three-dimen- 
sional space in a step S2. In a next step S3, the control- 
ler 20 converts the three-dimensional coordinates (pwx, 
pwy, pwz) of the attentional subject 33 into two-dimen- 
sional coordinates (pcx, pcy) thereof in the video game 
image, thereby determining coordinates in a plane f ield- 
of-view coordinate system of the attentional subject 33. 

Then, the controller 20 decides in a step S4 
whether or not the coordinates of the attentional subject 
33 are located outside of the coordinate area of the 
focus frame 34 in the displayed video game image for 
thereby deciding whether the attentional subject 33 has 
essentially moved out of the focus frame 34. If the atten- 
tional subject 33 has not essentially moved out of the 
focus frame 34("NCT in the step S4), then the controller 
20 displays the attentional subject 33 and a background 
image in the video game image displayed on the televi- 
sion monitor 2 at the time in a step S5. Thereafter, con- 
trol goes back to the step S1 to store next coordinates of 
the attentional subject 33 before it moves. 

If the attentional subject 33 has essentially moved 
out of the focus frame 34 ("YES" in the step S4), then 
the controller 20 determines an angle 6 of the direction, 
indicated by the arrow A, in which the attentional subject 
33 moves in the plane fiekJ-of -view coordinate system in 
a step S6. Specifically, the controller 20 calculates the 
angle 6 of the direction, indicated by the arrow A, based 
on the two-dimensional coordinates (pcx', pcy 1 ) of the 
attentional subject 33 stored in the RAM 8 and the two- 
dimensional coordinates (pcx, pcy) of the attentional 
subject 33 when it has moved out of the focus frame 34. 
Thereafter, the controller 20 decides in a step S7 
whether or not the central reference point 36 of the 
focus frame 34 has reached a boundary position of the 
center movement range 37. If the central reference 
point 36 has not reached a boundary position of the 
center movement range 37 ("NO" in the step S7), then 
the controller 20 moves the focus frame 34 in the direc- 
tion indicated by the arrow A, i.e., at the calculated 
angle 0 to bring the attentional subject 33 into the focus 
frame 34. Specifically, in order to bring the attentional 
subject 33 into the focus frame 34. the focus frame 34 is 
moved in the direction in which the attentional subject 
33 moves, at a speed greater than the speed at which 
the attentional subject 33 moves. In a next step S9, the 



controller 20 controls the image processor 12 to display 
the attentional subject 33 so as to be positioned in the 
focus frame 34. Thereafter, control goes back to the 
step S1 to store next coordinates of the attentional sub- 

s ject 33 before it moves. 

tf the central reference point 36 of the focus frame 
34 has reached a boundary position of the center move- 
ment range 37 in the step S7, then the controller 20 
moves the video camera 35 in the direction, indicated by 

10 the arrow A. at the angle e to bring the area in front of 
the attentional subject 33 into the f ield-of-view provided 
by the displayed video game image in a step S10. 
Thereafter, in a step S11, the controller 20 moves the 
focus frame 34 to locate the attentional subject 33 in a 

is rear position on an extension opposite to the direction, 
indicated by the arrow A, in which the attentional subject 
33 moves, and moves the video camera 35 to bring the 
attentional subject 33 into the moved focus frame 34 for 
thereby returning the attentional subject 33 to the rear 

20 position opposite to the direction indicated by the arrow 
A. In a step S12, the controller 20 displays on the televi- 
sion monitor 2 a video game image in which a wide 
empty area is provided in front of the attentional subject 

33 in the direction in which it moves and the attentional 
25 subject 33 is positioned in the focus frame 34. 

The attentional subject 33 is moved back in the 
opposite direction to the direction indicated by the arrow 
A in the displayed video game image at a speed which 
is selected depending on the speed at which the atten- 

30 tional subject 33 moves. The direction in which the 
attentional subject 33 is moved back is a linear direction 
opposite to the direction indicated by the arrow A. 

Then, the controller 20 decides in a step S13 
whether or not the central reference point 36 of the 

35 focus frame 34 has reached a boundary position of the 
center movement range 37. The steps S10. S11, S12 
are repeated until the central reference point 36 of the 
focus frame 34 has reached a boundary position of the 
center movement range 37. If the central reference 

40 point 36 of the focus frame 34 has reached a boundary 
position of the center movement range 37, then control 
goes back to the step S1 to store next coordinates of the 
attentional subject 33 before it moves. 

At this time, the focus frame 34 and the attentional 

45 subject 33 are positioned as shown by the dotted lines 
in FIG. 3B. As shown in FIG. 3B, a wide empty area is 
present in front of the attentional subject 33 in the direc- 
tion in which it moves. Thereafter, in the video game 
image displayed on the television monitor 2, the atten- 

50 tional subject 33 moves with the focus frame 34 in the 
direction indicated by the arrow A until the attentional 
subject 33 reaches a boundary line of the focus frame 

34 as shown in FIG. 6. When the attentional subject 33 
reaches a boundary line of the focus frame 34, control 

55 returns to the step S1 and repeats the steps S1 - S13 for 
thereby repeating the above process in which the atten- 
tional subject 33 moves to a limit of the range in which it 
is movable and thereafter is moved back to provide a 
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wide enpty area in front of the attentional subject 33 in 
the direction in which it moves. 

As described above, when the attentional subject 
33 is about to move out of the focus frame 34, the per- 
spective of the displayed video game image and the 5 
focus frame 34 are moved in order to locate the atten- 
tional subject 33 in a rear position on an extension 
opposite to the direction in which the attentional subject 
33 moves, and the attentional subject 33 is moved back 
in the displayed image in the opposite direction to the io 
direction indicated by the arrow A to bring the atten- 
tional subject 33 into the moved focus frame 34. Conse- 
quently, a certain wide area is provided in front of the 
attentional subject 33 in the direction in which it moves, 
and also around the attentional subject 33. The game is 
player who is viewing the video game image is now 
allowed to objectively see the attentional subject 33 and 
its surrounding areas. Since the wide area is provided in 
front of the attentional subject 33 in the direction in 
which it moves, it provides enough room for maneuver 20 
for the game player to take an action easily even when 
an opponent game character suddenly pops up in the 
displayed video game image. 

In the above embodiment, not only the perspective 
of the displayed video game image is moved in order to 25 
bring the attentional subject 33 into the focus frame 34, 
but also the focus frame 34 is moved back to a rear posi- 
tion on an extension opposite to the direction indicated 
by the arrow A in which the attentional subject 33 
moves, for providing a wide area in front of the atten- 30 
tional subject 33 in the direction in which it moves, and 
the attentional subject 33 is brought into the moved 
focus frame 34. The rear position, referred above, is a 
position in which the crisscross central reference point 
36 of the focus frame 34 is located on a circular bound- 35 
ary line of the circular center movement range 37 when 
the crisscross central reference point 36 is moved oppo- 
site and parallel to the direction indicated by the arrow 
A. 

According to another embodiment of the present 40 
invention, the controller 20 moves the perspective of the 
displayed video game image in the direction in which 
the attentional subject 33 moves in order to bring the 
attentional subject 33 into the focus frame 34. Further- 
more, when the central reference point 36 of the focus 45 
frame 34 has reached a boundary position of the center 
movement range 37 at the time the attentional subject 
33 is about to move out of the focus frame 34, the con- 
troller 20 moves the attentional subject 33 into the focus 
frame 34 which is moved so that the central reference so 
point 36 of the focus frame 34 will be located in a bound- 
ary position of the center movement range 37 which is 
in point-symmetry relation to the former boundary posi- 
tion of the center movement range 37 across the center 
of the center movement range 37. 55 

More specifically, as shown in FIG. 7, the focus 
frame 34 is moved back to a position in the opposite 
direction to the direction, indicated by the arrow A, in 
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which the attentional subject 33 moves, and the atten- 
tional subject 33 is kept within the focus frame 34, as 
indicated by the dotted lines. Furthermore, when the 
central reference point 36 of the focus frame 34 has 
reached a boundary position of the center movement 
range 37 at the time the attentional subject 33 is about 
to move out of the focus frame 34. the focus frame 34 is 
moved back so that the central reference point 36 of the 
focus frame 34 will be located in a boundary position 
36a of the center movement range 37 which is in point- 
symmetry relation to the former boundary position of the 
center movement range 37 across the center 37a of the 
center movement range 37. At this time, the attentional 
subject 33 is also moved back in a direction parallel to 
the direction in which the central reference point 36 of 
the focus frame 34 is moved to the boundary position 
36a of the center movement range 37 which is in point- 
symmetry relation to the former boundary position of the 
center movement range 37 across the center 37a of the 
center movement range 37. 

In the embodiment shown in FIG. 7. the controller 
20 functionally comprises a coordinate transforming 
means for transforming coordinates of the attentional 
subject 33 in a three-dimensional coordinate system 
into coordinates thereof in a plane field-of-view coordi- 
nate system, an image display control means for dis- 
playing the attentional subject 33 according to the 
coordinates transformed by the coordinate transforming 
means, together with a predetermined image, in a video 
game image, decision means for deciding whether the 
attentional subject 33 has moved out of the focus frame 
34 in the video game image, and image perspective 
moving means for controlling the image display control 
means to move the attentional subject 33 into the focus 
frame 34 which is moved, when the central reference 
point 36 of the focus frame 34 has reached a boundary 
position of the center movement range 37 at the time 
the attentional subject 33 is about to move out of the 
focus frame 34. so that the central reference point 36 of 
the focus frame 34 will be located in the boundary posi- 
tion 36a of the center movement range 37 which is in 
point-symmetry relation to the former boundary position 
of the center movement range 37 across the center 37a 
of the center movement range 37. The above function to 
move the focus frame 34 may be performed in the step 
S1 1 shown in FIG. 5. Otherwise, the video game appa- 
ratus according to the embodiment shown in FIG. 7 
operates according to the operation sequence shown in 
FIG. 5. 

According to still another embodiment of the 
present invention, the controller 20 moves the perspec- 
tive of the displayed video game image in the direction 
in which the attentional subject 33 in order that the 
attentional subject 33 is displayed in the focus frame 34. 
As shown in FIG. 8. moreover, the circular center move- 
ment range 37 in which the crisscross central reference 
point 36 of the rectangular focus frame 34 is movable is 
divided into four equal radial areas extending radially 
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outwardly from the center 37a of the circular center 
movement range 37. When central reference point 36 of 
the focus frame 34 has reached a boundary position of 
the center movement range 37 at the time the atten- 
tional subject 33 is about to move out of the focus frame 
34, the focus frame 34 is moved back so that the central 
reference point 36 of the focus frame 34 will be located 
on a boundary line of one of the radial areas, other than 
a radial area 37b that is closest to the attentional subject 
33, e.g., on a boundary line of a radial area 37c that is 
diametrically opposite to the radial area 37b, and the 
attentional subject 33 is brought into the focus frame 34 
thus moved. The circular center movement range 37 
may be divided into a plurality of radial areas such as six 
equal radial areas, rather than the four equal radial 
areas as illustrated. 

In the embodiment shown in FIG. 8, the controller 
20 functionally comprises a coordinate transforming 
means for transforming coordinates of the attentional 
subject 33 in a three-dimensional coordinate system 
into coordinates thereof in a plane field-of-view coordi- 
nate system, an image display control means for dis- 
playing the attentional subject 33 according to the 
coordinates transformed by the coordinate transforming 
means, together with a predetermined image, in a video 
game image, decision means for deciding whether the 
attentional subject 33 has moved out of the focus frame 
34 in the video game image, and image perspective 
moving means for controlling the image display control 
means to move the attentional subject 33 into the focus 
frame 34 which is moved, when the central reference 
point 36 of the focus frame 34 has reached a boundary 
position of the center movement range 37 at the time 
the attentional subject 33 is about to move out of the 
focus frame 34, so that the central reference point 36 of 
the focus frame 34 will be located in one of divided 
areas of the center movement range 37 other than the 
divided area closest to the attentional subject 33. The 
above function to move the focus frame 34 may be per- 
formed in the step Si 1 shown in FIG. 5. Otherwise, the 
video game apparatus according to the embodiment 
shown in FIG. 8 operates according to the operation 
sequence shown in FIG. 5. 

The reference point 36 of the focus frame 34 has 
been described as being located at the center of the 
focus frame 34. However, the reference point 36 of the 
focus frame 34 may be located at an off-center position 
of the focus frame 34. If the focus frame 34 is of a rec- 
tangular shape, then the reference point 36 may be 
located at a coordinate point on a comer of the focus 
frame 34. 

Although certain preferred embodiments of the 
present invention have been shown and described in 
detail, it should be understood that various changes and 
modifications may be made therein without departing 
from the scope of the appended claims 



Claims 

1. An apparatus for displaying a video image to move 
a perspective of the image in a direction in which an 
5 attentional subject moves for displaying the atten- 
tional subject in an attentional area in the video 
image, comprising: 

image display means for displaying the atten- 
10 tional subject in the attentional area in the 

video image; and 

control means for moving the perspective of the 
video image in the direction in which the atten- 
tional subject moves in the video image, and 
is moving the perspective of the video image and 

the attentional area when said attentional sub- 
ject is about to move out of said attentional 
area. 

20 2. An apparatus according to claim 1, wherein said 
control means moves the perspective of the video 
image and the attentional area so that said atten- 
tional subject will be located in a rear position oppo- 
site to said direction in which the attentional subject 

25 moves, when said attentional subject is about to 
move out of said attentional area. 

3. An apparatus according to claim 2, wherein said 
control means comprises: 

30 

coordinate transforming means for transform- 
ing coordinates of the attentional subject in a 
three-dimensional coordinate system into coor- 
dinates thereof in a plane field-of-view coordi- 

35 nate system; 

coordinate holding means for holding coordi- 
nates of the attentional subject transformed by 
said coordinate transforming means before 
and after the attentional subject moves; 

40 image display control means for displaying the 

attentional subject according to the coordinates 
transformed by said coordinate transforming 
means, together with a predetermined image, 
in the video image; 

45 decision means for deciding whether the atten- 

tional subject has moved out of said attentional 
area in the video image; 
calculating means for calculating a direction in 
which the attentional subject has moved based 

so on the coordinates held by said coordinate 

holding means, if the attentional subject has 
moved out of said attentional area; and 
image perspective moving means for control- 
ling said image display control means to move 

55 the perspective of the video image and the 

attentional area so that the attentional subject 
will be located in the rear position opposite to 
the direction calculated by said calculating 
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means. 

4. An apparatus according to claim 1, wherein said 
control means moves the perspective of the video 
image and the attentional area, when a reference s 
point of said attentional area has reached a first 
position in a reference point movement range, in 
which said reference point is movable, at the time 
said attentional subject is about to move out of said 
attentional area, so that said attentional subject will 10 
be located in the attentional area that is moved to a 
second position in the reference point movement 
range which is in point-symmetry relation to said 
first position across a center of said reference point 
movement range. *s 

5. An apparatus according to claim 4, wherein said 
control means comprises: 

coordinate transforming means for transform- 20 
ing coordinates of the attentional subject in a 
three-dimensional coordinate system into coor- 
dinates thereof in a plane field-of-view coordi- 
nate system; 

decision means for deciding whether the atten- 25 
tional subject has moved out of said attentional 
area in the video image; and 
image perspective moving means for moving 
said attentional subject into said attentional 
area which is moved, when said reference 30 
point of the attentional area has reached said 
first position at the time the attentional subject 
is about to move out of said attentional area, so 
that said reference point will be located in said 
second position which is in point-symmetry 35 
relation to said first position across the center 
of the reference point movement range. 

6. An apparatus according to claim 5, wherein said 
control means moves the perspective of the video 40 
image and the attentional area, when a reference 
point of said attentional area has reached a bound- 
ary position of a reference point movement range, 

in which said reference point is movable, at the time 
said attentional subject is about to move out of said 45 
attentional area, so that said attentional subject will 
be located in the attentional area that is moved with 
the reference point thereof located in a first one of 
divided radial areas of the reference point move- 
ment range other than a second one of the divided 50 
radial areas that is closest to said attentional sub- 
ject. 

7. An apparatus according to claim 6. wherein said 
control means comprises: ss 

coordinate transforming means for transform- 
ing coordinates of the attentional subject in a 
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three-dimensional coordinate system into coor- 
dinates thereof in a plane field-of-view coordi- 
nate system; 

decision means for deciding whether the atten- 
tional subject has moved out of said attentional 
area in the video image; and 
image perspective moving means for moving 
said attentional subject into said attentional 
area which is moved, when said reference 
point of the attentional area has reached said 
boundary position at the time the attentional 
subject is about to move out of said attentional 
area, so that said reference point will be 
located in the attentional area that is moved 
with the reference point thereof located in said 
first one of divided radial areas of the reference 
point movement range other than said second 
one of the divided radial areas that is closest to 
said attentional subject. 

8. A method of displaying a video image to move a 
perspective of the image in a direction in which an 
attentional subject moves for displaying the atten- 
tional subject in an attentional area in the video 
image, comprising the steps of: 

transforming coordinates of the attentional sub- 
ject in a three-dimensional coordinate system 
into coordinates thereof in a plane field-of-view 
coordinate system; 

deciding whether the attentional subject has 
moved out of said attentional area in the video 
image; and 

moving the perspective of the video image and 
the attentional area when said attentional sub- 
ject is about to move out of said attentional 
area in the video image. 

9. A method according to claim 8, further comprising 
the steps of: 

holding transformed coordinates of the atten- 
tional subject before and after the attentional 
subject moves; 

displaying the attentional subject according to 
the transformed coordinates, together with a 
predetermined image, in the video image; and 
calculating a direction in which the attentional 
subject has moved based on the coordinates 
which are held, if the attentional subject has 
moved out of said attentional area; 

wherein the perspective of the video 
image and the attentional area are moved so 
that the attentional subject will be located in a 
rear position opposite to the calculated direc- 
tion. 

10. A method according to claim 8, wherein the per- 
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specth/e of the video image and the attentional area 
are moved, when a reference point of said atten- 
tional area has reached a first position in a refer- 
ence point movement range, in which said 
reference point is movable, at the time said atten- 
tional subject is about to move out of said atten- 
tional area, so that said attentional subject will be 
located in the attentional area that is moved to a 
second position in the reference point movement 
range which is in point-symmetry relation to said 
first position across a center of said reference point 
movement range. 

1 1 . A method according to claim 8, wherein said atten- 
tional subject is moved into said attentional area 
which is moved, when a reference point of said 
attentional area has reached a boundary position of 
a reference point movement range, in which said 
reference point is movable, at the time said atten- 
tional subject is about to move out of said atten- 
tional area, so that said attentional subject will be 
located in the attentional area that is moved with 
the reference point thereof located in a first one of 
divided radial areas of the reference point move- 
ment range other than a second one of the divided 
radial areas that is closest to said attentional sub- 
ject. 

12. A recording medium which stores a control program 
for displaying a video image to move a perspective 
of the image in a direction in which an attentional 
subject moves for displaying the attentional subject 
in an attentional area in the video image, said con- 
trol program comprising the steps of: 

transforming coordinates of the attentional sub- 
ject in a three-dimensional coordinate system 
into coordinates thereof in a plane f ield-of-view 
coordinate system; 

deciding whether the attentional subject has 
moved out of said attentional area in the video 
image; and 

moving the perspective of the video image and 
the attentional area when said attentional sub- 
ject is about to move out of said attentional 
area in the video image. 



which are held, if the attentional subject has 
moved out of said attentional area; 

wherein the perspective of the video 
image and the attentional area are moved so 
5 that the attentional subject will be located in a 

rear position opposite to the calculated direc- 
tion. 

14. A recording medium according to claim 12, wherein 
w the perspective of the video image and the atten- 
tional area are moved, when a reference point of 
said attentional area has reached a first position in 
a reference point movement range, in which said 
reference point is movable, at the time said atten- 

75 tional subject is about to move out of said atten- 
tional area, so that said attentional subject will be 
located in the attentional area that is moved to a 
second position in the reference point movement 
range which is in point-symmetry relation to said 

20 first position across a center of said reference point 
movement range. 

15. A recording medium according to claim 12, wherein 
said attentional subject is moved into said atten- 
ds tional area which is moved, when a reference point 

of said attentional area has reached a boundary 
position of a reference point movement range, in 
which said reference point is movable, at the time 
said attentional subject is about to move out of said 

30 attentional area, so that said attentional subject will 
be located in the attentional area that is moved with 
the reference point thereof located in a first one of 
divided radial areas of the reference point move- 
ment range other than a second one of the divided 

35 radial areas that is closest to said attentional sub- 
ject. 



40 



45 



13. A recording medium according to claim 12. farther 
comprising the steps of: 

so 

holding transformed coordinates of the atten- 
tional subject before and after the attentional 
subject moves; 

displaying the attentional subject according to 
the transformed coordinates, together with a ss 
predetermined image, in the video image; and 
calculating a direction in which the attentional 
subject has moved based on the coordinates 
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(54) Image perspective control for video game images 



(57) The perspective of a displayed video game 
image is moved in order to bring an attentional subject 
into a hypothetical focus frame, and the focus frame is 
moved back to a rear position on an extension opposite 
to the direction in which the attentional subject moves, 
for providing a wide area in front of the attentional sub- 
ject in the direction in which it moves, and the attentional 
subject is brought into the moved focus frame. The rear 
position is a position in which a central reference point 
of the focus frame is located on a boundary line of the 

FIG. 1 



circular center movement range when the central refer- 
ence point is moved opposite and parallel to the direc- 
tion in which the attentional subject moves. The wide 
area provided in front of the attentional subject in the 
direction in which it moves, provides enough room for 
maneuver for the game player to take an action easily 
even when an opponent game character suddenly pops 
up in the displayed video game image. 
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